Information processing apparatus, method and computer-readable medium

ABSTRACT

In one example embodiment, an information processing apparatus causes a display device to display a first image in a display range. In this embodiment, the first image is from images associated with an observation target object. The images include a first image, a second image, and a third image. In response to a request to change the display range, the information processing apparatus changes the display range at a first speed, and causes the display range to display the second image. In response to a request to terminate the change of the display range, the information processing apparatus changes the display range at a deceleration speed, and causes the display range to display the third image.

CROSS REFERENCES TO RELATED APPLICATIONS

The present application claims priority to Japanese Patent ApplicationNo. JP 2009-272813, filed in the Japanese Patent Office on Nov. 30,2009, the entire contents of which is being incorporated herein byreference.

BACKGROUND

In a field of medicine, pathology, or the like, there has been proposeda system that digitizes an image of a cell, a tissue, an organ, or thelike of a living body, that is obtained by an optical microscope, toexamine the tissue or the like by a doctor or a pathologist or diagnosea patient based on the digitized image.

For example, Japanese Patent Application Laid-open No. 2009-37250(hereinafter, referred to as Patent Document 1) discloses a method inwhich an image optically obtained by a microscope is digitized by avideo camera with a CCD (charge coupled device), a digital signal isinput to a control computer system, and the image is visualized on amonitor. A pathologist performs examination while watching the imagedisplayed on the monitor (see, for example, paragraphs [0027] and [0028]and FIG. 5 of Patent Document 1). Generally, such a system is called avirtual microscope.

Incidentally, in the case of the past virtual microscope disclosed inPatent Document 1, for moving a display range of an image or zooming animage by a user, a user has to repeatedly perform operations of dragginga mouse or rotating a scroll wheel thereof, for example. However, animage used in the virtual microscope has a large size of 50×50 (Kpixel:kilopixel), for example. For this reason, to thoroughly observe such animage is a very hard task for a user. In particular, a pathologistperforms such a task all day long. If the operations are troublesome,they may be stressful. There is fear that a change in pathologicaltissue that should be found may be missed, which may cause amisdiagnosis.

In view of the above-mentioned circumstances, it is desirable to providean information processing apparatus, an information processing method,and a program therefor capable of reducing user's operations necessaryfor moving a display range of an image in a virtual microscope and makean observation task efficient.

SUMMARY

The present disclosure relates to an information processing apparatus, amethod, and a computer-readable medium for controlling display of animage obtained by a microscope in a field of medicine, pathology,biology, materials science, or the like.

In one example embodiment, an information processing apparatus includesa processor, and a memory device operatively coupled to the processor,the memory device storing instructions that cause the processor, incooperation with the memory device, to: (a) cause a display device todisplay a first image in a display range, the first image being fromimages associated with an observation target object (e.g., a section ofbiological tissue), the images including a first image, a second image,and a third image; (b) in response to a request to change the displayrange: (i) change the display range at a first speed; and (ii) cause thedisplay range to display the second image; and (c) in response to arequest to terminate the change of the display range: (i) change thedisplay range at a deceleration speed; and (ii) cause the display rangeto display the third image.

In one example embodiment, the second image is different from the firstimage, and the third image is different from the first image.

In one example embodiment, the images associated with the observationtarget object are observed by a microscope.

In one example embodiment, the images include a fourth image associatedwith the observation target object. In this embodiment, the instructionscause the processor to, in response to the request to change beingterminated, after the display range displays the third image, cause thedisplay range to display the fourth image.

In one example embodiment, the information processing apparatus includesan input device which is operatively coupled to the processor. In thisembodiment, the instructions cause the processor to operate with theinput device to enable a user to request the change of the display rangeusing a dragging operation.

In one example embodiment, the information processing apparatus includesan input device having a button operatively coupled to the processor. Inthis embodiment, the instructions cause the processor to operate withthe input device to enable a user to request the termination of thechange of the display range by releasing the button.

In one example embodiment, the instructions cause the processor to,using at least one of the first speed and the deceleration speed,determine which of the images are to be displayed.

In one example embodiment, the images include a feature part. In oneexample embodiment, the instructions cause the processor to, when thedisplay range is being changed at the decelerated speed, determinewhether the display range reaches the feature part. In one exampleembodiment, the instructions cause the processor to, in response to thedisplay range reaching the feature part, increase the decelerationspeed.

In one example embodiment, the images include frequency components. Inthis embodiment, the instructions cause the processor to: (a) generatefeature data by measuring the frequency components, the frequency dataindicating a frequency level; and (b) using the frequency level,determine the deceleration speed.

In one example embodiment, the information processing apparatus includesan input device. In one example embodiment, the instructions cause theprocessor to operate with input device to, when the display range isbeing changed at the decelerated speed, enable a user to instantaneouslystop the movement of the display range. In one example embodiment, theinstructions cause the processor to operate with input device to, whenthe display range is being changed at the decelerated speed, enable auser to, using a pressure applied to the input device, cause themovement of the display range to stop.

In one example embodiment, the first image is generated at a firstresolution, the second image is generated at a second resolution, andthe third image is generated at a third resolution. In one exampleembodiment, the images include a fourth image associated with theobservation target object. In one example embodiment, the instructionscause the processor to, in response to the request to change beingterminated, after the display range displays the third image, cause thedisplay range to display the fourth image.

In one example embodiment, the instructions cause the processor tooperate with the input device to enable a user to request the change ofthe display range using a zoom operation.

In one example embodiment, the displayed first image has a first area,and the displayed second image a second area, the second area beingnarrower than the first area.

In one example embodiment, a method of operating an informationprocessing apparatus including instructions includes: (a) causing adisplay device to display a first image in a display range, the firstimage being from images associated with an observation target object,the images including a first image, a second image, and a third image;(b) in response to a request to change the display range: (i) causing aprocessor to execute the instructions to change the display range at afirst speed; and (ii) causing the display range to display the secondimage; and (c) in response to a request to terminate the change of thedisplay range: (i) causing a processor to execute the instructions tochange the display range at a deceleration speed; and (ii) causing thedisplay range to display the third image.

In one example embodiment, a computer-readable medium storesinstructions structured to cause an information processing apparatus to:(a) cause a display device to display a first image in a display range,the first image being from images associated with an observation targetobject, the images including a first image, a second image, and a thirdimage; (b) in response to a request to change the display range: (i)change the display range at a first speed; and (ii) cause the displayrange to display the second image; and (c) in response to a request toterminate the change of the display range: (i) change the display rangeat a deceleration speed; and (ii) cause the display range to display thethird image.

As described above, according to the embodiments of the presentdisclosure, it is possible to reduce the user's operation necessary forthe movement of the display range of the image in the virtualmicroscope, which can make the observation task efficient.

These and other objects, features and advantages of the presentdisclosure will become more apparent in light of the following detaileddescription of best mode embodiments thereof, as illustrated in theaccompanying drawings.

Additional features and advantages are described herein, and will beapparent from the following Detailed Description and the figures.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a block diagram showing the structure of an exampleinformation processing system including an information processingapparatus according to an example embodiment of the present disclosure.

FIG. 2 is a diagram showing an example image pyramid structure forexplaining a display principle according to an example embodiment of thepresent disclosure.

FIG. 3 is a diagram for explaining a procedure at a time when an imagegroup of the image pyramid structure shown in FIG. 2 is generated.

FIG. 4 is a flowchart showing an example operation of a PC according toan example embodiment of the present disclosure.

FIG. 5 is a diagram showing an example operation at a time of a movementoperation on a display range, out of the operation of the PC accordingto an example embodiment of the present disclosure.

FIGS. 6A, 6B, 6C and 6D are diagrams each showing an operation at a timeof a movement operation on a display range, out of the operation of thePC according to an example embodiment of the present disclosure.

FIG. 7A and 7B are diagrams each showing a state of feature analysis ofan entire image in the embodiment of the present disclosure.

FIG. 8 is a flowchart showing an example calculation process of afrequency level in parts of the entire image in an example embodiment ofthe present disclosure.

FIGS. 9A and 9B are diagrams each schematically showing an examplegeneration process of an existence frequency matrix from a DCTcoefficient matrix of the entire image by the PC in an exampleembodiment of the present disclosure.

FIG. 10 is a diagram schematically showing an example generation processof a frequency score matrix from the existence frequency matrix and ahigh-frequency detection matrix by the PC in an example embodiment ofthe present disclosure.

FIG. 11 is a diagram showing the appearance and the inner structure ofan example mouse used in another embodiment of the present disclosure.

DETAILED DESCRIPTION

Hereinafter, embodiments of the present disclosure will be describedwith reference to the drawings.

[Structure of Information Processing Apparatus]

FIG. 1 is a block diagram showing the structure of an exampleinformation processing system including an information processingapparatus according to an example embodiment of the present disclosure.In one example embodiment, the information processing apparatus includesa PC (personal computer) 100.

The PC 100 includes a CPU (central processing unit) 101, a ROM (readonly memory) 102, a RAM (random access memory) 103, an input and outputinterface (hereinafter, abbreviated as I/O interface) 105, and a bus 104that connects those components with one another.

The CPU 101 accesses the RAM 103 or the like when necessary and performsoverall control on blocks of the PC 100 while performing variouscomputation processing. The ROM 102 is a non-volatile memory in which OSexecuted by the CPU 101, a program, or a firmware such as variousparameters is fixedly stored. The RAM 13 is used as a work area or thelike for the CPU 101, and temporarily holds the OS, various runningprograms, or various data items during processing.

To the I/O interface 105, a display unit 106, an input unit 107, astorage unit 108, a communication unit 109, a drive unit 110, and thelike are connected.

The display unit 106 is a display device that uses liquid crystal, EL(electro-luminescence), a CRT (cathode ray tube), or the like. Thedisplay unit 106 may be incorporated in the PC 100 or may be externallyconnected to the PC 100.

The input unit 107 is, for example, a pointing device, a keyboard, atouch panel, or another operation apparatus. In the case where the inputunit 107 includes a touch panel, the touch panel may be integrated withthe display unit 106.

The storage unit 108 is a non-volatile memory such as an HDD (hard diskdrive), a flash memory, and another solid-state memory. In the storageunit 108, an image obtained by an optical microscope (described later)is stored.

The drive unit 110 is a device capable of driving a removable recordingmedium 111 such as an optical recording medium, a floppy (registeredtrademark) disk, a magnetic recording tape, and a flash memory. Incontrast, the storage unit 108 is often used as a device that ispreviously included in the PC 100 and mainly drives a recording mediumthat is not removable.

The communication unit 109 is a modem, a router, or anothercommunication apparatus that is connectable to a LAN (local areanetwork), a WAN (wide area network), or the like and is used forcommunicating with another device. The communication unit 109 mayperform either one of a wired communication or a wireless communication.The communication unit 109 is used separately from the PC 100 in manycases.

Next, a description will be given on an image that is obtained by anoptical microscope (not shown) and on a principle of displaying theimage. The image is mainly stored in the storage unit 108 of the PC 100.FIG. 2 is a diagram showing an example image structure for explainingthe display principle.

As shown in FIG. 2, the image used in this embodiment has a pyramidstructure (image pyramid structure 50). The image pyramid structure 50is an image group generated at a plurality of resolutions with respectto one image obtained from one observation target object 15 (see, FIG.3) by the optical microscope. In this embodiment, images that constitutethe image group are each referred to as an entire image. On a lowermostpart of the image pyramid structure 50, a largest image is disposed, andon an uppermost part thereof, a smallest image is disposed. A resolutionof the largest image is 50×50 (Kpixel) or 40×60 (Kpixel), for example. Aresolution of the smallest image is 256×256 (pixel) or 256×512 (pixel),for example. Further, the entire images are images compressed by JPEGcompression, for example, but the compression system is not limited tothis.

The PC 100 extracts, from the entire images included in the imagepyramid structure 50, an image of a part (hereinafter, referred to aspartial image) corresponding to a predetermined display range of thedisplay unit 106 as appropriate, and reads out the partial image on theRAM 103, to be output by the display unit 106. Here, in FIG. 2, thedisplay range of the display unit 106 is represented by D.

FIG. 3 is a diagram for explaining an example procedure of generatingthe image group of the image pyramid structure 50.

First, a digital image of an original image obtained at a predeterminedobservation magnification by an optical microscope (not shown) isprepared. The original image corresponds to the largest image that isthe lowermost image of the image pyramid structure 50 shown in FIG. 2,that is, the entire image at a highest resolution. Therefore, as thelowermost entire image of the image pyramid structure 50, an imageobtained by the observation at a relatively high magnification by theoptical microscope is used.

It should be noted that in the field of pathology, generally, a matterobtained by slicing an organ, a tissue, or a cell of a living body, or apart thereof is an observation target object 15. Then, a scannerapparatus (not shown) having a function of the optical microscope readsthe observation target object 15 stored on a glass slide, to obtain adigital image and store the digital image obtained into the scannerapparatus or another storage apparatus.

As shown in FIG. 3, the scanner apparatus or a general-purpose computer(not shown) generates, from the largest image obtained as describedabove, a plurality of entire images whose resolutions are reducedstepwise, and stores those entire images in unit of “tile” that is aunit of a predetermined size, for example. The size of one tile is256×256 (pixel), for example. The image group generated as describedabove forms the image pyramid structure 50, and the storage unit 108 ofthe PC 100 stores the image pyramid structure 50. Actually, the PC 100only has to store the entire images whose resolutions are different withthe entire images being associated with resolution information items,respectively. In addition, the generating and storing of the imagepyramid structure 50 may be performed by the PC 100 shown in FIG. 1.

The PC 100 uses software that employs the system of the image pyramidstructure 50, to extract a partial image corresponding to the displayrange D from the entire image at an arbitrary resolution of the imagepyramid structure 50 in accordance with an input operation by a userthrough the input unit 107. Then, the PC 100 reads the partial image onthe RAM 103, and subsequently output the partial image on the displayunit 106. In addition, in the case where a movement operation is inputby the user, with respect to the partial image displayed, the PC 100moves the display range D on the entire image from which the partialimage is extracted, and extracts the partial image included in thedisplay range D after being moved, to be output. Further, in the casewhere the user inputs a zoom operation with respect to the partial imagedisplayed, the PC 100 extracts, from the entire image whose resolutionis different from the entire image from which the partial imageconcerned is extracted, a partial image corresponding to a wide-areaimage or a narrow-area image of the partial image, to be output. Throughsuch a processing, the user can get a feeling of observing theobservation target object 15 while changing the observationmagnification. That is, the PC 100 functions as a virtual microscope. Avirtual observation magnification in this case corresponds to aresolution in reality.

Here, the display range D does not refer to the maximum display rangesize of the display unit 106, but refers to a range of the whole or apart of the display range of the display unit 106, which can be set bythe user as appropriate, for example. Further, the display range Dcorresponds to an area in which the tiles are placed in multiple rowsand multiple columns.

[Operation of Information Processing Apparatus]

Next, the operation of the PC 100 structured as described above will bedescribed.

FIG. 4 is a flowchart showing an example operation of the PC 100according to an example embodiment. FIG. 5 is a diagram showing anexample operation at the time when the movement operation of the displayrange D out of the operation of the PC 100 is performed. FIGS. 6A, 6B,6C and 6D are diagrams each showing an operation at the time when thezoom operation of the display range D, which is included in theoperation of the PC 100, is performed.

Software stored in the storage unit 108, the ROM 102, or the like and ahardware resource of the PC 100 are cooperated with each other, therebyimplementing the following processing of the PC 100. Specifically, theCPU 101 loads a program that forms the software stored in the storageunit 108, the ROM 102, or the like and executes the program, therebyimplementing the following processing.

First, the user accesses a file including the image group of the imagepyramid structure 50 through an input operation using the input unit107. In response to this, the CPU 101 of the PC 100 extracts apredetermined partial image from the image pyramid structure 50 storedin the storage unit 108 and reads the predetermined partial image on theRAM 103, to be displayed on the display unit 106 (Step 51). Thepredetermined partial image that is included in the image pyramidstructure 50 and accessed by the CPU 101 first may be set by default orby the user as appropriate.

Typically, the CPU 101 first displays a partial image in the entireimage, which has a resolution corresponding to an observationmagnification of a relatively low resolution (low magnification), e.g.,1.25 times.

Subsequently, the CPU 101 waits for an input operation from the inputunit 107 by the user (Step 52).

When the user operates the input unit 107 to shift the display range Dto a desired position (YES in Step 52), the CPU 101 judges whether theoperation is a movement operation or not (Step 53). Typically, themovement operation is a dragging operation using a mouse.

In the case where the operation by the user is the movement operation(YES in Step 53), the CPU 101 moves the display range D on the entireimage from which the partial image is extracted in accordance with thespeed of the movement operation (at the same speed as the movementoperation speed), and reads the partial image of a part where thedisplay range D after being moved is disposed on the RAM 103, to bedisplayed (Step 54).

Subsequently, the CPU 101 judges whether the movement operation(dragging operation) is terminated or not, that is, the user releases amouse button (Step 55).

In the case where it is judged that the movement operation is terminated(YES in Step 55), the CPU 101 further moves the display range D on theentire image at a speed reduced from the movement operation speedmentioned above at a predetermined deceleration (Step 56). That is, theCPU 101 maintains the movement of the display range D while reducing thespeed.

The movement speed (V) in this case is updated for each display range Daccording to the following equation:V=V*S (0<S<1.0)  (1)

in which S represents deceleration.

In the example of FIG. 5, first, the mouse is dragged rightward, therebymoving the display range D rightward. As a result, a partial image P1 isupdated to a partial image P2 disposed on the right hand of the partialimage P1 ((A) and (B) in FIG. 5). Then, even when the dragging operationis terminated, the movement of the display range D is continued whilebeing decelerated ((B) and (C) in FIG. 5). Thus, even after the draggingoperation is terminated, the user can visually feel as if the displayrange D is continuously moved by an inertial force.

In the case of the movement of the display range D while beingdecelerated as described above, the CPU 101 can calculate a partialimage that is expected to be necessary and time when the partial imagebecomes necessary, on the basis of the movement speed (V) and themovement direction. Therefore, prior to the movement of the displayrange D, the CPU 101 can load at least a part of the partial imagecorresponding to a position to which the display range D is moved, thatis, the tile from the image pyramid structure 50 to the RAM 103. Thus,the movement of the display range D is smoothly performed.

Returning the flowchart of FIG. 4, in the case where it is judged thatthe user operation is not the movement operation in Step 53, the CPU 101judges whether the user operation is the zoom operation or not (Step57). Typically, the zoom operation is a rotating operation of a scrollwheel of a mouse.

In the case where it is judged that the operation is the zoom operation(YES in Step 57), the CPU 101 changes, at the same speed as the speed ofthe zoom operation, an original partial image that is already displayedinto a partial image corresponding to a wide-area image or narrow-areaimage of the original partial image in an entire image different fromthe original image from which the original partial image is extracted(Step 58).

For example, as shown in FIGS. 6A and 6B, in the case where the zoom-inoperation is input for the partial image P1, the CPU 101 extracts, fromthe image pyramid structure 50, the partial image P2 corresponding tothe narrow-area image of the partial image P1 in an entire image at aresolution different from that of the entire image from which thepartial image P1 is extracted, and changes the partial image P1 into thepartial image P2.

Subsequently, the CPU 101 judges whether the zoom operation (wheelrotation operation) is terminated or not, that is, the user releases thescroll wheel of the mouse or not (Step 59).

In the case where it is judged that the zoom operation is terminated(YES in Step 59), the CPU maintains the changing of the partial imagebetween the different entire images at a speed reduced from the zoomoperation speed at a predetermined deceleration (Step 60). The zoomspeed decelerated in this case is calculated in the same way as theequation (1) relating to the movement speed (V).

In the example of FIG. 6, when the user rotates the scroll wheel of themouse outwardly, the original partial image P1 in the display range D ischanged to the partial image P2 of a narrower area in the differententire image at the rotation speed (FIGS. 6A and 6B). Then, even whenthe scroll-wheel rotation operation is terminated, the changing of thepartial images (from P2 to P3) between the different entire images iscontinued while being decelerated (FIGS. 6B and 6C). Thus, even afterthe zoom operation is terminated, the user can visually feel as if thezoom operation is continued by an inertial force.

Returning to the flowchart of FIG. 4, the CPU 101 judges whether toreach a feature part in the entire image or not during a time periodwhen the display range D is moved while being decelerated after themovement operation or during a time period when the partial image ischanged while being decelerated after the zoom operation (Step 61).

Here, the feature part refers to a part in which an image component isdrastically changed in the entire image, for example. The feature partis detected by analyzing the entire image at a predetermined analysismethod. FIG. 7A and 7B are diagrams each showing a state where theentire image concerned is subjected to feature analysis.

As shown in FIG. 7A and 7B, an entire image W is divided into aplurality of cluster regions (C1 to C4) by a clustering process, forexample. Data relating to boundary lines of the plurality of clusterregions is stored in the storage unit 108 as feature data, and CPU 101reads the feature data into the RAM 103 for the movement operation andthe zoom operation.

The generation of feature data may not necessarily require the dividingprocess into the cluster regions by the clustering process. For example,the CPU 101 can also generate the feature data by measuring frequencycomponents in the entire image. FIG. 8 is a flowchart showing ageneration process of the feature data by the measurement of thefrequency components. Further, FIGS. 9 and 10 are diagrams showing apart of the measurement process of the frequency components.

For the measurement of the frequency components, a DCT coefficient inperforming JPEG compression on the entire images is used, for example.That is, as shown in FIG. 8, the CPU 101 first extracts, from the entireimage, DCT coefficient matrix data for each block of 8×8 (Step 81).Based on the DCT coefficient matrix, an amount of high-frequencycomponents for each 8×8 block is revealed.

Subsequently, the CPU 101 generates a matrix (existence frequencymatrix) obtained by changing, to 1, a numerical value of a cell whosenumerical value is not 0 in the DCT coefficient matrix, as shown in FIG.9 (Step 82). Further, the CPU 101 generates a matrix (high frequencydetection matrix) in which the numerical values become larger as thehigher-frequency components are obtained (toward the lower right cornerof the matrix) (Step 83).

Subsequently, as shown in FIG. 10, the CPU 101 multiplies the numericalvalues of corresponding cells of the existence frequency matrix and thehigh frequency detection matrix, thereby generating a new matrix(frequency score matrix) (Step 84).

Subsequently, the CPU 101 adds the pieces of data of all the cells ofthe frequency score matrix to obtain a total value, and set the totalvalue as a frequency value of an 8×8 block image (Step 85).

Then, the CPU 101 calculates the frequency value of each of the 8×8block images with respect to the whole of the entire images (Step 86).Further, the CPU 101 divides the frequency value of each of the 8×8block images by the maximum value of each of the 8×8 block images in theentire images, thereby calculating a frequency level (F) that isnormalized for each of the 8×8 block images (Step 87).

Here, data obtained by quantizing the DCT coefficient may be usedinstead of the DCT coefficient matrix.

The CPU 101 stores, as the feature data, the frequency level (F) foreach 8×8 block image of the entire image into the RAM 103.

Returning to the flowchart of FIG. 4, in the case where it is judgedthat the display range D reaches the feature part in the entire image(YES in Step 61), that is, it is judged that the frequency level (F) inthe entire image is changed, the CPU 101 increases the deceleration inaccordance with the frequency level (F) (Step 62). Specifically, the CPU101 calculates the deceleration (S) based on the following equation, todisplay the partial image in accordance therewith.S=1.0−F  (2)

With the process described above, the movement or the zoom in an areathat the user is less interested in is performed quickly, while themovement or the zoom in an area that is important for the user isperformed carefully (slowly). For example, physically, a frictioncoefficient differs depending on the areas of the entire image, and sucha display effect that a brake is further applied on a part where theimage is changed is obtained. As a result, the user is prevented frommissing a specific part as much as possible.

Through the processes described above, the CPU 101 judges whether theuser inputs the click operation during the zoom or the movementdecelerated of the display range D or whether the speed reaches 0 or notdue to the deceleration (Step 63).

In the case where the click operation is input or the speed reaches 0(YES in Step 63), the CPU 101 stops the movement of the display range Dthat has been subjected to the movement operation or the changing of thepartial image after the zoom operation (Step 64, (D) in FIG. 5 and FIG.6D). The click operation by the user stops the changing of the partialimage or the movement of the display range D, with the result that theuser can be prevented from missing a timing at which the partial imageduring the movement or the zoom due to the pseudo inertial force reachesan interesting part.

Through the processes described above, even after the movement operationor the zoom operation is not input by the user, the PC 100 can give sucha visual effect that the operation is maintained due to the inertialforce while being decelerated. Therefore, the number of operation timesin the case where the user manually performs the movement operation orthe zoom operation is reduced to a great extent. In particular, theefficiency of the operation by a pathologist for a pathologicaldiagnosis is increased, with the result that the missing of a seriouspart is significantly reduced. In addition, the deceleration isincreased in a specific part (high-frequency component), which furtherprevents the missing of the part.

MODIFIED EXAMPLE

The present disclosure is not limited to the above embodiment, and canbe variously modified without departing from the gist of the presentdisclosure.

In the above embodiment, in the case where the user inputs the clickoperation of the mouse during the zoom or the movement decelerated, theCPU 101 instantaneously stops the movement of the display range D afterbeing moved or the changing of the partial image after the zoomoperation. However, the manner of the stop is not limited to this. Forexample, in the case where the user inputs the click operation after thezoom operation or the movement operation by the user is terminated(after the user releases the button), the CPU 101 may change thedeceleration in accordance with a pressure applied to the mouse by theclick.

Specifically, as shown in FIG. 11, for example, in a left button 111 ofa mouse 110 serving as the input unit 107, a pressure sensor such as apressure-sensitive sheet 112 is provided. The pressure sensor detects apressure applied by a finger of the user, for example. Thepressure-sensitive sheet may be provided not in the left button 111 buton the surface thereof. For the pressure sensor, any pressure-sensitiveelement of a semiconductor diaphragm type, a capacitance type, anelastic diaphragm type, a piezoelectric type, a vibration type, abourdon tube type, a bellows type or the like may be used. Further,instead of the sheet shape, a three-dimensional sensor may be used.

When the user performs the click operation on the left button with themouse during the zoom operation or the movement operation decelerated,the CPU 101 changes the predetermined deceleration on the basis of thevalue of the pressure applied to the left button by the click operation,that is, an analog quantity input from the pressure-sensitive sheet 112.

Typically, the CPU 101 increases the deceleration, as the pressure valuedetected becomes larger. That is, depending on the pressure valuedetected, the CPU 101 calculates a deceleration based on the followingequation, to display the partial image in accordance therewith.S=1.0−P  (3)

in which P represents a value obtained by normalizing the pressurevalue.

As a result, by applying the pressure using the mouse 110 during a timeperiod when the zoom or the movement is continued at a speeddecelerated, the user can get such an operation feeling that a brake isapplied due to a friction force in accordance with the pressure withrespect to the zoom or the movement. More specifically, for example, theuser can get an operation feeling as if the user stops the rotation of arotating globe by a finger's friction force. Therefore, the user canstop the movement or the zoom with an intuitive operation feeling.

In the case where a touch panel or a touch pad is used as the input unit107 instead of the mouse 110, the same processes are implemented byproviding the pressure sensor in the touch panel or the touch pad, forexample.

In the above, the description is given on the mode in which the imagedata that forms the image pyramid 50 is stored in the storage unit 108of the PC 100. However, another computer separated from the PC 100 or aserver may store the image data that forms the image pyramid structure50, and the PC 100 used by the user as a terminal apparatus may accessthe computer or the server to receive the image data. In this case, thePC 100 as the terminal apparatus and the server or the like may beconnected via a network such as a LAN and a WAN. In particular, the useof the WAN can realize telepathology, telediagnosis, or the like. Inaddition, the generation process of the feature data (frequency level)may be executed by the computer separated from the PC 100 or the server,and the PC 100 may receive the feature data therefrom.

In the above, the description is given on the mode in which, as theoriginal image of the image pyramid structure 50, one original image isgenerated with respect to the one observation target object 15. However,with respect to the one observation target object 15, a plurality oforiginal images may be generated in the thickness direction of theobservation target object 15, which is a focus direction of the opticalmicroscope. This is called Z-stack, which is a function to deal with thecase where tissues or cells may have different shapes also in thethickness direction of the observation target object 15. A scannerapparatus has the Z-stack function in many cases, and about 5 to 10 or10 to 30 original images are generated.

In the above embodiment, the PC 100 generates the feature data in theentire image by measuring the frequency components of the entire image.However, the PC 100 may generate the feature data by detecting astandard deviation, a contrast, an edge, or the like in the entireimage, other than the frequency, or combining them.

The PC is used as the information processing apparatus according to theabove embodiment, but a dedicated information processing apparatus maybe used instead of the PC. Further, the information processing apparatusis not limited to an apparatus that implements the above-describedinformation processing in cooperation with the hardware resource and thesoftware. Dedicated hardware may implement the above-describedinformation processing.

It should be understood that various changes and modifications to thepresently preferred embodiments described herein will be apparent tothose skilled in the art. Such changes and modifications can be madewithout departing from the spirit and scope and without diminishing itsintended advantages. It is therefore intended that such changes andmodifications be covered by the appended claims.

The application is claimed as follows:
 1. An information processingapparatus comprising: a processor; an input device operatively coupledto the processor; and a memory device operatively coupled to theprocessor, the memory device storing instructions that cause theprocessor, in cooperation with the memory device, to: (a) cause adisplay device to display a first image in a display range, the firstimage being from images associated with an observation target object,the images including the first image, which is generated at a firstresolution, a second image, which is generated at a second resolutiondifferent from the first resolution, and a third image, which isgenerated at a third resolution different from the first resolution andthe second resolution, wherein the images are divided into a pluralityof cluster regions having boundary lines; (b) in response to a requestfrom the input device to change the display range using a zoomoperation: (i) change the display range at a first speed; and (ii) causethe display range to display the second image at the second resolution;(c) in response to a request from the input device to terminate thechange of the display range using the zoom operation: (i) change thedisplay range at a first deceleration speed, which is slower than thefirst speed, and maintain movement at the first deceleration speed,based on the request from the input device to terminate the change ofthe display range using the zoom operation; and (ii) cause the displayrange to display the third image at the third resolution; (d) whilechanging the display range at the first deceleration speed, determinethat the display range has reached a boundary line of a cluster regionafter the request to terminate the change of the display range using thezoom operation and before the change of the display range using the zoomoperation is terminated; and (e) in response to the display rangereaching the boundary line of the cluster region, increase decelerationsuch that the display range is changed at a second deceleration speed.2. The information processing apparatus of claim 1, wherein the secondimage is different from the first image, and the third image isdifferent from the first image.
 3. The information processing apparatusof claim 2, wherein the observation target object includes a section ofbiological tissue.
 4. The information processing apparatus of claim 2,wherein the images associated with the observation target object areobserved by a microscope.
 5. The information processing apparatus ofclaim 2, wherein: (a) the images include a fourth image associated withthe observation target object; and (b) the instructions, when executedby the processor, cause the processor to, in response to the request tochange being terminated, after the display range displays the thirdimage, cause the display range to display the fourth image.
 6. Theinformation processing apparatus of claim 2, wherein the instructions,when executed by the processor, cause the processor to operate with theinput device to enable a user to request the change of the display rangeusing a dragging operation.
 7. The information processing apparatus ofclaim 2, wherein the input device includes a button operatively coupledto the processor, wherein the instructions, when executed by theprocessor, cause the processor to operate with the input device toenable a user to request the termination of the change of the displayrange by releasing the button.
 8. The information processing apparatusof claim 2, wherein the instructions, when executed by the processor,cause the processor to, using at least one of the first speed and thefirst deceleration speed, determine which of the images are to bedisplayed.
 9. The information processing apparatus of claim 2, wherein:(a) the images include frequency components; (b) the instructions, whenexecuted by the processor, cause the processor to: (i) generate featuredata by measuring the frequency components, the frequency dataindicating a frequency level; and (ii) using the frequency level,determine the first deceleration speed.
 10. The information processingapparatus of claim 2, wherein the instructions, when executed by theprocessor, cause the processor to operate with input device to, when thedisplay range is being changed at the first deceleration speed, enable auser to instantaneously stop the movement of the display range.
 11. Theinformation processing apparatus of claim 2, wherein the instructions,when executed by the processor, cause the processor to operate withinput device to, when the display range is being changed at the firstdeceleration speed, enable a user to, using a pressure applied to theinput device, cause the movement of the display range to stop.
 12. Theinformation processing apparatus of claim 1, wherein the observationtarget object includes a section of biological tissue.
 13. Theinformation processing apparatus of claim 1, wherein the imagesassociated with the observation target object are observed by amicroscope.
 14. The information processing apparatus of claim 1,wherein: (a) the images include a fourth image associated with theobservation target object; and (b) the instructions, when executed bythe processor, cause the processor to, in response to the request tochange being terminated, after the display range displays the thirdimage, cause the display range to display the fourth image.
 15. Theinformation processing apparatus of claim 1, which includes an inputdevice having a button operatively coupled to the processor, wherein theinstructions, when executed by the processor, cause the processor tooperate with the input device to enable a user to request thetermination of the change of the display range by releasing the button.16. The information processing apparatus of claim 1, wherein theinstructions, when executed by the processor, cause the processor todetermine, using at least one of the first speed and the firstdeceleration speed, which of the images are to be displayed.
 17. Theinformation processing apparatus of claim 1, wherein the instructions,when executed by the processor, cause the processor to operate withinput device to, when the display range is being changed at the firstdeceleration speed, enable a user to instantaneously stop the movementof the display range.
 18. The information processing apparatus of claim1, wherein the instructions, when executed by the processor, cause theprocessor to operate with input device to, when the display range isbeing changed at the first deceleration speed, enable a user to, using apressure applied to the input device, cause the movement of the displayrange to stop.
 19. The information processing apparatus of claim 1,wherein the displayed first image has a first area, and the displayedsecond image a second area, the second area being narrower than thefirst area.
 20. A method of operating an information processingapparatus including instructions, the method comprising: (a) causing adisplay device to display a first image in a display range, the firstimage being from images associated with an observation target object,the images including the first image, which is generated at a firstresolution, a second image, which is generated at a second resolutiondifferent from the first resolution, and a third image, which isgenerated at a third resolution different from the first resolution andthe second resolution, wherein the images are divided into a pluralityof cluster regions having boundary lines; (b) in response to a requestfrom an input device to change the display range using a zoom operation:(i) causing a processor to execute the instructions to change thedisplay range at a first speed; and (ii) causing the display range todisplay the second image at the second resolution; (c) in response to arequest from an input device to terminate the change of the displayrange using the zoom operation: (i) causing a processor to execute theinstructions to change the display range at a first deceleration speed,which is slower than the first speed, and maintain movement at the firstdeceleration speed, based on the request from the input device toterminate the change of the display range using the zoom operation; and(ii) causing the display range to display the third image at the thirdresolution; (d) while changing the display range at the firstdeceleration speed, determine that the display range has reached aboundary line of a cluster region after the request to terminate thechange of the display range using the zoom operation and before thechange of the display range using the zoom operation is terminated; and(e) in response to the display range reaching the boundary line of thecluster region, increase the deceleration such that the display range ischanged at a second deceleration speed.
 21. A non-transitorycomputer-readable medium storing instructions structured to cause aninformation processing apparatus to: (a) cause a display device todisplay a first image in a display range, the first image being fromimages associated with an observation target object, the imagesincluding the first image, which is generated at a first resolution, asecond image, which is generated at a second resolution different fromthe first resolution, and a third image, which is generated at a thirdresolution different from the first resolution and the secondresolution, wherein the images are divided into a plurality of clusterregions having boundary lines; (b) in response to a request from aninput device to change the display range using a zoom operation: (i)change the display range at a first speed; and (ii) cause the displayrange to display the second image at the second resolution; (c) inresponse to a request from an input device to terminate the change ofthe display range using the zoom operation: (i) change the display rangeat a first deceleration speed, which is slower than the first speed, andmaintain movement at the first deceleration speed, based on the requestfrom the input device to terminate the change of the display range usingthe zoom operation; and (ii) cause the display range to display thethird image at the third resolution; (d) while changing the displayrange at the first deceleration speed, determine that the display rangehas reached a boundary line of a cluster region after the request toterminate the change of the display range using the zoom operation andbefore the change of the display range using the zoom operation isterminated; and (e) in response to the display range reaching theboundary line of the cluster region, increase the deceleration such thatthe display range is changed at a second deceleration speed.